Searching PAJ 



2003-338926 



PATENT ABSTRACTS OF JAPAN 



(1 1 )Publication number : 2003-338926 
(43)Date of publication of application : 28.1 1.2003 



(51)Int.CI. 




H04N 1/40 






G06T 5/00 








H04N 1/19 




(21 Application number : 


2002-145536 


(71)Applicant 


: CANON INC 


(22)Date of filing : 


21.05.2002 


(72)lnventor : 


FUKAWA YOSHIHIKO 




(54) IMAGE PROCESSING METHOD AND APPARATUS THEREOF 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image 
processing method and an image processing apparatus 
for greatly reducing the correction processing time of 
dust noise and improving the productivity of high-quality 
image data, by automatically detecting the dust noise 
contained in image data as defective pixels for 
correction, and further for adding the elimination of the 
dust noise also in a series of automatic processing from 
the reading to the output of the image data. 
SOLUTION: An arbitrary pixel to be noticed is compared 
with a nearby pixel to extract a pixel within a specific 
range including the pixel to be noticed for satisfying 
specific conditions as a target pixel. A histogram is 
created for the extracted target pixel, and the flatness 
of a given region is confirmed according to histogram 
characteristics, thus verifying that the defective pixel is 
included in the given region. When the defective pixel is 
included, a pixel where the gradation level with a 
correction value determined according to given 

conditions satisfies specific conditions is extracted as a defective pixel, thus substituting the 
correction value for the defective pixel. 
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1 This document has been translated by computer. So the translation may not reflect the original 
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2.**** shows the word which can not be translated. 
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CLAIMS 



[Claim(s)] 

[Claim 1]An image processing method which processes image data constituted by pixel, 
comprising: 

An object picture element detection process which detects an object picture element group 
containing a noticed picture element from which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1 st threshold from said image data. 
A defect pixel determination process judged to be that in which said object picture element 
contains a defect pixel when a criterion value is calculated based on concentration frequency 
distribution which comprises said object picture element and this criterion value turns into 
beyond the 2nd threshold. 

A correcting process which a gradation level difference with an adjusted value calculated from 
said concentration frequency distribution among said object picture elements extracts a pixel 
which is beyond the 3rd threshold as said defect pixel, and corrects this defect pixel using said 
adjusted value. 

[Claim 2]An image processing method which processes image data constituted by pixel, 
comprising: 

An object picture element detection process which detects an object picture element group 
containing a noticed picture element from which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1st threshold from said image data. 
A defect pixel determination process judged to be that in which said object picture element 
contains a defect pixel when the 1st and 2nd criterion values are calculated based on 
concentration frequency distribution which comprises said object picture element and these 1st 
and 2nd criterion values turn into [ both ] beyond the 2nd threshold. 

A correcting process which both gradation level differences with the 1st and 2nd adjusted values 
calculated from said concentration frequency distribution among said object picture elements 
extract a pixel which is beyond the 3rd threshold as said defect pixel, and corrects this defect 
pixel using either said 1st [ the ] or the 2nd adjusted value. 

[Claim 3]The image processing method according to claim 1 or 2, wherein said object picture 
element is a pixel group in a fixed range centering on said noticed picture element. 
[Claim 4]The image processing method according to claim 1 or 2, wherein said criterion value is a 
rate over the total number of object picture elements of pixel frequency which is in a fixed 
gradation range in said concentration frequency distribution. 

[Claim 5]The image processing method according to claim 2, wherein said 1st and 2nd criterion 
values are the rates over said total number of object picture elements of pixel frequency which 
is in a fixed gradation range which does not overlap mutually in said concentration frequency 
distribution. 

[Claim 6]The image processing method according to claim 1 or 2, wherein said adjusted value is 
given as average value of a pixel used in order to compute said criterion value. 
[Claim 7]The image processing method according to claim 1 or 2, wherein said adjusted value is 
given as a mean value of a gradation level range which a pixel used in order to compute said 
criterion value can take. 

[Claim 8]The image processing method according to claim 1 or 2 replacing in said correcting 

process by an adjusted value to which said defect pixel was given by claim 6 or 7. 

[Claim 9]The image processing method according to claim 2 choosing the 1st or the 2nd adjusted 
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value, and replacing a defect pixel by comparing the 1st and 2nd pixel numbers used in said 

correcting process in order to compute said 1st and 2nd criterion values. 

[Claim 10]An image processing device which processes image data constituted by pixel, 

comprising: 

An object picture element detection process which detects an object picture element group 
containing a noticed picture element from which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1 st threshold from said image data. 
A defect pixel determination process judged to be that in which said object picture element 
contains a defect pixel when a criterion value is calculated based on concentration frequency 
distribution which comprises said object picture element and this criterion value turns into 
beyond the 2nd threshold. 

A correcting process which a gradation level difference with an adjusted value calculated from 
said concentration frequency distribution among said object picture elements extracts a pixel 
which is beyond the 3rd threshold as said defect pixel, and corrects this defect pixel using said 
adjusted value. 

[Claim 1 1]An image processing device which processes image data constituted by pixel, 
comprising: 

An object picture element detection process which detects an object picture element group 
containing a noticed picture element from which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1 st threshold from said image data. 
A defect pixel determination process judged to be that in which said object picture element 
contains a defect pixel when the 1 st and 2nd criterion values are calculated based on 
concentration frequency distribution which comprises said object picture element and these 1st 
and 2nd criterion values turn into [ both ] beyond the 2nd threshold. 

A correcting process which both gradation level differences with the 1st and 2nd adjusted values 
calculated from said concentration frequency distribution among said object picture elements 
extract a pixel which is beyond the 3rd threshold as said defect pixel, and corrects this defect 
pixel using either said 1 st [ the ] or the 2nd adjusted value. 

[Claim 12]The image processing device according to claim 10 or 11, wherein said object picture 
element is a pixel group in a fixed range centering on said noticed picture element. 
[Claim 13]The image processing device according to claim 10 or 1 1, wherein said criterion value 
is a rate over the total number of object picture elements of pixel frequency which is in a fixed 
gradation range in said concentration frequency distribution. 

[Claim 14]The image processing method device according to claim 2, wherein said 1st and 2nd 
criterion values are the rates over said total number of object picture elements of pixel 
frequency which is in a fixed gradation range which does not overlap mutually in said 
concentration frequency distribution. 

[Claim 15]The image processing method device according to claim 10 or 1 1, wherein said 
adjusted value is given as average value of a pixel used in order to compute said criterion value. 
[Claim 16]The image processing device according to claim 10 or 1 1, wherein said adjusted value 
is given as a mean value of a gradation level range which a pixel used in order to compute said 
criterion value can take. 

[Claim 17]The image processing device according to claim 10 or 1 1 replacing in said correcting 
process by an adjusted value to which said defect pixel was given by claim 1 5 or 1 6. 
[Claim 18]The image processing device according to claim 11 choosing the 1st or the 2nd 
adjusted value, and replacing a defect pixel by comparing the 1st and 2nd pixel numbers used in 
said correcting process in order to compute said 1 st and 2nd criterion values. 
[Claim 19]An object picture element detection means to detect an object picture element group 
containing a noticed picture element to which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1 st threshold from said image data about a 
computer, A defect pixel judging means judged to be that in which said object picture element 
contains a defect pixel when a criterion value is calculated based on concentration frequency 
distribution which comprises said object picture element and this criterion value turns into 
beyond the 2nd threshold, A computer program making it function as a correcting means which a 
gradation level difference with an adjusted value calculated from said concentration frequency 
distribution among said object picture elements extracts a pixel which is beyond the 3rd 
threshold as said defect pixel, and corrects this defect pixel using said adjusted value. 
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[Claim 20]An object picture element detection means to detect an object picture element group 
containing a noticed picture element to which a difference of a gradation level with a 
neighborhood picture element becomes beyond the 1 st threshold from said image data about a 
computer, The 1st and 2nd criterion values are calculated based on concentration frequency 
distribution which comprises said object picture element, A defect pixel judging means judged to 
be that in which said object picture element contains a defect pixel when these 1st and 2nd 
criterion values turn into [ both ] beyond the 2nd threshold, Both gradation level differences with 
the 1st and 2nd adjusted values calculated from said concentration frequency distribution among 
said object picture elements extract a pixel which is beyond the 3rd threshold as said defect 
pixel, A computer program making it function as a correcting means which corrects this defect 
pixel using either said 1 st [ the ] or the 2nd adjusted value. 

[Claim 21]The computer program according to claim 19 or 20 operating a computer with said 
object picture element being a pixel group in a fixed range centering on said noticed picture 
element. 

[Claim 22]The computer program according to claim 19 or 20 operating a computer with said 
criterion value serving as a rate over the total number of object picture elements of pixel 
frequency in a fixed gradation range in said concentration frequency distribution. 
[Claim 23]The computer program according to claim 20 operating a computer with said 1st and 
2nd criterion values serving as a rate over said total number of object picture elements of pixel 
frequency which is in a fixed gradation range which does not overlap mutually in said 
concentration frequency distribution. 

[Claim 24]The computer program according to claim 19 or 20 operating a computer with said 
adjusted value being given as average value of a pixel used in order to compute said criterion 
value. 

[Claim 25]The computer program according to claim 1 9 or 20 operating a computer with said 
adjusted value being given as a mean value of a gradation level range which a pixel used in order 
to compute said criterion value can take. 

[Claim 26]The computer program according to claim 19 or 20 operating a computer with 
replacing in said correcting process by an adjusted value to which said defect pixel was given by 
claim 24 or 25. 

[Claim 27]By comparing the 1st and 2nd pixel numbers used in said correcting process in order 
to compute said 1st and 2nd criterion values. The computer program according to claim 19 or 20 
operating a computer with choosing the 1st or the 2nd adjusted value, and replacing a defect 
pixel. 

[Claim 28]A computer readable storage medium storing a computer program of a statement in 
any 1 paragraph of claims 1 9 thru/or 26. 



[Translation done.] 



http://vvvvw4.ipdljnpit.gojp/cgi-bin/tran_web_cgi_ejje 2009/07/02 



JP,2003-338926,A [DETAILED DESCRIPTION] 



2003-338926 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the image processing method and image 
processing device which correct the dust noise by the dust etc. which are applied to an image 
processing method and an image processing device, especially are contained in given image data. 

[0002] 

[Description of the Prior Art]There are some which generally electronic-dataHze the picture 
drawn on the manuscript as one of the techniques of generating electronic image data using 
picture input devices, such as a scanner. By this technique, although image data is generable 
simple, the dust adhering to a manuscript, the dirt adhering to the reading surface of the picture 
input device, etc. will be read as image data. For this reason, the image of that dirt was included 
as a noise which originally is not an ingredient of a picture. 

[0003]The technique of taking the average value of the picture element data of the 
circumference to the noticed picture element considered to be a noise as such a removing 
method of a noise was taken. 

[0004]A noise is identified to a processing object image and there is JP,4-316275,A to perform a 
solvent wiping removal to the noise. When image data is scanned per window of the 
predetermined size centering on a noticed picture element in this noise rejection method, The 
window is divided into two or more blocks, and when only the number beyond the 2nd threshold 
exists in a block of the pixel from which a gradation level difference with a noticed picture 
element becomes beyond the 1st threshold and the pattern of the block is predetermined shape, 
a noticed picture element is judged to be a noise. Next, noise correction processing is performed 
in calculating ******** anc | replacing the result of having classified the pixel whose gradation 
level difference with a noticed picture element is beyond the 3rd threshold at intervals of the 
predetermined level about the pixel in a window, and having compared the pixel number between 
the level by noticed picture element data. 
[0005] 

[Problem(s) to be Solved by the Invention]However, there is a problem which degrades pictures 
other than the noise of the outline of an object fading by the technique of taking the average 
value of the surrounding picture element data to a noticed picture element, In a correcting 
method like JP,4-316275,A, the above-mentioned judgment procedure will have to be stepped on 
to all the pixels which constitute a picture, and extracting a noise pixel will take time. Since it 
must ask for the gradation level for replacing to one pixel judged to be a noise from two or more 
pixels, time will be required also about correction processing. 

[0006]This invention was made in view of this point, and the purpose is to detect automatically 
the dust noise contained in image data as a defect pixel, and to correct it, While shortening the 
correction processing time of a dust noise substantially, the productivity of high-definition image 
data is raised, and it is in providing the image processing method and image processing device 
which can add removal of a dust noise also in a series of automatic processings from reading of 
image data to an output further. 
[0007] 

[Means for Solving the Problem]In order to solve the above-mentioned technical problem, a 
place by which it is characterized [ of the invention according to claim 1 in this application ] is in 
an image processing method comprising and an image processing device. 
[0008](a) The 1st calculating process that computes a gradation level difference of arbitrary 
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pixels of image data, and a neighborhood picture element of said arbitrary pixel top, the bottom, 
the left, or/and the right. 

[0009](b) The 1st extraction process that extracts arbitrary pixels which become beyond the 1st 
predetermined threshold, and a neighborhood picture element centering on said arbitrary pixels 
as an object picture element based on said 1st calculating process result. 
[00103(c) The 2nd calculating process that computes a predetermined criterion value and an 
adjusted value based on concentration frequency distribution which comprises said object 
picture element 

[001 1](d) The 1st determination process judged as said object picture element containing a 
defect pixel based on said 2nd calculating process when said criterion value turns into beyond 
the 2nd predetermined threshold. 

[0012](e) The 2nd extraction process that extracts a pixel which becomes beyond the 3rd 
[ predetermined in a gradation level difference with said adjusted value ] threshold as a defect 
pixel about said object picture element 

[0013](f) A correcting process which corrects said defect pixel using said adjusted value. 
[001 4]A place by which it is characterized [ of the invention according to claim 2 in this 
application ] is in an image processing method comprising and an image processing device. 
[0015](a) The 1st calculating process that computes a gradation level difference of arbitrary 
pixels of image data, and a neighborhood picture element of said arbitrary pixel top, the bottom, 
the left, or/and the right 

[00161(b) The 1st extraction process that extracts arbitrary pixels which become beyond the 1st 
predetermined threshold, and a neighborhood picture element centering on said arbitrary pixels 
as an object picture element based on said 1st calculating process result 
[0017](c) The 2nd calculating process that computes the 1st and 2nd predetermined criterion 
value and 1 st and 2nd adjusted values based on concentration frequency distribution which 
comprises said object picture element 

[0018](d) The 1st determination process judged as said object picture element containing a 
defect pixel based on said 2nd calculating process when said 1st and 2nd criterion values turn 
into beyond the 2nd predetermined threshold. 

[001 93(e) The 2nd extraction process that extracts a pixel which becomes beyond the 3rd 
[ predetermined in both gradation level differences with said 1st and 2nd adjusted values 3 
threshold as a defect pixel about said object picture element. 

[00203(f) A correcting process which corrects said defect pixel using either said 1st [ the ] or 
the 2nd adjusted value. 

[002l3(Work for ) In an image processing device of this invention, a pixel of a prescribed range 
containing a noticed picture element which measures arbitrary noticed picture elements and 
neighborhood picture elements, and fulfills predetermined conditions is extracted as an object 
picture element A histogram is created about an extracted object picture element, the surface 
smoothness of a given field is checked from the characteristic of a histogram, and it checks that 
a defect pixel is contained in a given field. When a defect pixel is contained, a gradation level with 
correction value determined according to given conditions extracts a pixel which fulfills 
predetermined conditions as a defect pixel, and replaces a defect pixel with correction value. 
[0022]Image deterioration can be prevented by this, and from one noticed picture element, two 
or more dust noise pixels can be specified, correction processing can be carried out, and time to 
start total dust noise detection and correction processing can be shortened. 
[00233 

[Embodiment of the Invention3The embodiment which applied this invention to below based on 
the drawing is described in detail and concretely. 

[00243(A 1st embodiment) Drawing 1 is a block diagram showing the functional constitution of 
the image processing device provided with the image processing portion 102 which applied this 
invention. In drawing 1 , 101 is an image reader which reads image data. As an image reader, lay a 
manuscript, for example on platen glass, and a manuscript is irradiated through platen glass, 
Optoelectric transducers, such as CCD which condensed the catoptric light and has been 
arranged to the focal plane, generate the electrical signal for every pixel according to image 
concentration, and the optical image scanner outputted as image data which digitized the signal 
is used. 

[00253 An interface (I/F) for 103 to input image data from the image processing portion 102, The 
image memory 104 remembers image data to be, and 105 deltaLgradation level difference 1 
calculation part, 106 deltaLgradation level difference threshold value 2 set part and 107 a radius 
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set part and 108 An object picture element extraction part, 109 — as for rate threshold of 
flatness F2 set part, and 1 13, a gradation level width set part and 111 are [ deltaLgradation level 
difference threshold value 3 set part and 115] defect pixel corrected parts a defect pixel 
judgment part and 1 14 the rate F1 calculation part of flatness, and 112 a concentration- 
frequency-distribution preparing part and 110. 

[0026]In the composition of drawing 1 , the image processing method in a 1st embodiment is 
explained in detail, referring to drawing 3 and concentration-frequency-distribution drawing 4 in 
which the flow chart of drawing 2 and picture-element-data arrangement are shown. In drawing 
2, image data is already read by the image reader 101, and makes the initial state the state 
where it is stored in the image memory 104. 

[0027]In Step S201, first the deltaLI calculation part 105, As image data is read from the image 
memory 1 04 and it is shown in drawing 3 , paying attention to arbitrary picture-element-data A of 
them Gradation level difference deltaLI x of this noticed picture element A and the comparison 
position pixels L and M of that left-hand side, Gradation level difference deltaLly of the noticed 
picture element A and the upper comparison position pixels D and I is computed as follows. A 
which is numerals which show a pixel, B, etc. are used also as numerals which show the 
concentration gradation of the pixel as it is. In order not to leak and to scan the whole picture as 
a selection method of the noticed picture element A, the method of choosing one by one in 
order of raster scanning is desirable. 
[0028] 

deltaLI x= ** Ax2-(L+M) ** — (1) 
deltaLI y= ** Ax2-(D+I) ** — (2) 

The large value of this deltaLI x and deltaLly is made into the gradation level difference deltaLI 
of the noticed picture element A. This calculation processing is performed by the deltaLgradation 
level difference 1 calculation part 105. In the case of color image data, it is performed as follows, 
for example. Difference deltaLI xr of the gradation level of a noticed picture element and a pixel 
on either side, deltaLI xg, and deltaLI xb are calculated for every color component of RGB, and 
those sums are used for it as deltaLI x of a formula (1). It asks similarly about deltaLy. This 
method is the same also about the following explanation or other embodiments, and when 
searching for the difference of a gradation level, it can be obtained in this way. 
[0029]The calculating method of deltaLI is not having restricted to the above-mentioned 
example, and may use either deltaLI x or deltaLly. It is good also as a calculating method of 
using a longitudinal direction and a sliding direction without using left-hand side and the upper 
part direction for calculation of deltaLI x or deltaLly. Also in such a case, the gradation level 
difference of a noticed picture element and a comparison position pixel is used as deltaLI x or 
deltaLly. When determining deltaLI, in this embodiment, only the pixel which followed the 
noticed picture element and one way is used, but the comparison position pixel which separated 
2 pixels or more from the noticed picture element may be used. 

[0030]deltaL1 is a value computed in order to use the local correlativity which image data has 
that the correlation degree of the pixel value which constitutes that locally is high. Therefore, if 
it is a range which can expect to correlate with the noticed picture element as a pixel of the 
comparison object to a noticed picture element, it can choose. That is, although the pixel which 
separated 2 pixels or more from the noticed picture element may be used, you must not be any 
pixel at all, but it is necessary to be a pixel near the noticed picture element, and it good to 
choose an adjacent pixel like [ it is desirable and ] this embodiment. This range is changed also 
with the resolution at the time of reading the size and image data of a dust noise which are 
assumed. For example, when 2 pixels left by a certain fixed pixel number are observed, if it is 
high resolution in order for the physical size of a dust noise not to change, even if it has a 
correlation degree of a certain grade, the correlation degree falls with a low resolution. Here, the 
range which can expect to correlate with the noticed picture element in image data shall be 
called near the noticed picture element. 

[0031]Next, in Step S202, it is judged whether by the object picture element extraction part 108, 
the 1st threshold deltaL2 and gradation level difference deltaLI that were set up by the 1st 
deltaLthreshold 2 set part 106 are compared, and it is set to deltaLI >=deltaL2. When set to 
deltaLI >=deltaL2, it progresses to Step S203. Otherwise, a noticed picture element is moved to 
the following unsettled pixel. 

[0032]The 1st threshold deltaL2 is a value for narrowing down the pixel number used as the 
determination object of whether for it to be a threshold forjudging a possibility that a noticed 
picture element is a dust noise, and to be a dust noise performed succeedingly after this. Since 
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it is a value for narrowing down, the purpose can be attained if the value of the 1st threshold 
deltal_2 is larger than zero, and it is 1, for example (a gradation level shall be expressed with 
integers, such as 0-255). In addition, as a deciding method of the 1st threshold deltaL2, For 
example, the comparatively uniform local images which do not include the boundary of an object 
are experimentally gained from natural pictures etc., the gradation level deitaLI (deltaLIR) in 
there is computed by an upper formula, and how to determine the minimum numerical value used 
as deitaLI R<delta L2 as deltaL2 etc. can be considered. 

[0033]The deltal_2 set part 106 can consist of memories which memorize the value inputted 
beforehand. 

[0034]In Step S203, the pixel of the range of the radius set as the radius set part 107 by the 
object picture element extraction part 108 focusing on the noticed picture element is extracted 
as an object picture element. For example, in the case of drawing 3 , it can be called the object 
picture element of the radius 2 centering on a noticed picture element. 

[0035]The extraction method of an object picture element is not having restricted to the above- 
mentioned example, and inside [ it is a noticed picture element and an adjacent pixel of the four 
directions ] may extract either as an object picture element at least The pixel which left 2 pixels 
or more may be extracted from a noticed picture element. However, it is restricted to the range 
of the neighborhood which also mentioned this range above. The operation [ extract / not only / 
literally ] which sets the state where same processing can be performed to having extracted 
substantially of memorizing the address of the pixel in an image memory, for example, and making 
reference possible if needed is also included in extraction here. 

[0036]Next, in Step S204, the concentration frequency distribution of the pixel group extracted 
by the object picture element extraction part 1 08 is created. 

[0037]In the case of color image data, in creation of the above-mentioned concentration 
frequency distribution, any 1 color is used among each RGB color ingredients, for example. 
[0038]Next, the frequency of the image data for every gradation range set as the level width set 
part 1 10 at Step S205 is computed, and the rate (rate of flatness) over the total pixel number of 
the largest thing of frequency is searched for. For example, the case where the concentration 
frequency distribution of drawing 3 is expressed with drawing 4 is considered. When the level 
width set as the level width set part 1 10 is 10, the concentration frequency in each tonal range 
is as follows. 
[0039] 

gradation level Concentration frequencies 0-9 01-10 02-11 0...26-35 1...38-47 1639-48 1940-49 
1941-50 19 ... 87- 96188- 97 2...246-255 0 — and Rate F1of flatness =0.76 is calculated by 
dividing the concentration frequency 19 with the largest value by the total pixel number 25 
among these concentration frequencies. 

[0040]Calculation which calculates rate F1 of flatness from concentration frequency distribution 
is performed by the rate calculation part 1 1 1 of flatness. Next, in Step S206, it is judged whether 
by the defect pixel judgment part 1 13, the 2nd threshold F2 and rate F1 of flatness that were set 
up by the 2nd threshold F2 set part 1 12 are compared, and it is set to F1>=F2. When set to 
F1>=F2, it progresses to Step S207. Otherwise, a noticed picture element is moved to the 
following unsettled pixel. 

[0041 ]The 2nd threshold F2 is a threshold forjudging the surface smoothness of a reference 
pixel group, and is a value forjudging whether a dust noise exists in an object picture element 
group. As a deciding method of the 2nd threshold F2, gain experimentally the comparatively 
uniform local images which do not include the boundary of an object from natural pictures etc., 
for example, and gradation level F1 (F1R) in there is computed by an upper formula, How to 
determine the minimum numerical value used as deltaF1R<F2 as F2 etc. can be considered. 
[0042]Next, at Step S207, a defect pixel is extracted out of an object image, and correction 
processing is performed from a normal region portion without a defect. An adjusted value is first 
computed about the pixel in an object picture element group from the gradation level of two or 
more pixels used in order to calculate rate F1 of flatness. A pixel with a larger gradation level 
difference with this adjusted value than the threshold deltaF3 set as the deltaFgradation level 
difference threshold value 3 set part 1 14 is extracted as a defect pixel. Next, the defect pixel is 
replaced by the adjusted value calculated previously. 

[0043]Calculation of an adjusted value, extraction of a defect pixel, and correction processing of 
a defect pixel are performed by the defect pixel corrected part 1 1 5. It explains in detail, using 
drawing 4 about a case with a radius [ like the point ] of 2 pixels as an example as this 
correction disposal method. First, the range pixel which exists in the biggest level width, for 
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example, 40-49, of the concentration frequency for which it asked at Step S205 is extracted. 
Next, the average value 45 of these pixels is calculated. When the threshold deltaF3 is set to 10, 
four pixels which had 55 or more gradation levels which added threshold F3=10 in the average 
value 45 like the point are extracted as a defect pixel. It means that the defect pixel was 
corrected by replacing these four defect pixels by the adjusted value 45. 

[0044]In the upper example, the biggest gradation level of concentration frequency is very good 
in the average value of the pixel which exists in the range of 39-50 in this case, although three, 
39-48, 40-49, 41-50, exist. In the case of color image data, it has also come out to make each 
color component of a defect pixel into a new value by the average value calculated for every 
color component of the pixel used for averaging. 

[0045]The correcting method of a defect pixel may not be having restricted to the above- 
mentioned example, but the method which is replaced with the mean value of the pixel group 
used for calculation of a criterion value, or has been replaced enough and carried out with the 
picture element data nearest to the average value of an object picture element group may be 
sufficient as it. However, since the correlativity of local images is used also for amendment of a 
defect pixel as mentioned above, a radius cannot be set up indefinitely. What can be set up 
needs to be the range which can expect correlativity, i.e., the neighborhood picture element 
which is defect pixels. 

[0046]It judges whether at Step S208, processing was made to all the pixels, and when not made, 
a noticed picture element is moved to the following unsettled pixel. 

[0047]When judged with all the pixels having been processed at Step S208, processing of the 1st 
example is ended. 

[0048]The dust noise which exists in image data as mentioned above can be detected 
automatically and efficiently, and can be removed. Detection of a dust noise is performed 
extracting gradually the number of the pixels which serve as a candidate. And since it does not 
need to perform decision processing detailed about all the pixels since the judgment which 
processing takes time is performed in the stage which extracted the pixel number to some 
extent, and it can detect two or more noise pixels from one more noticed picture element, it can 
shorten the time which total noise detection and correction take. 

[0049]That is, in each stage, the candidate of a noise is detected for a noticed picture element 
based on the gradation level difference of a noticed picture element and its neighborhood picture 
element. And it asks for the concentration homogeneity of the pixel of the neighborhood within 
the limits, and a defect pixel is judged based on the rate of homogeneity. If a defect pixel is 
extracted eventually, the gradation level of the pixel of the range will amend the defect pixel 
soon. At this time, in the stage of the beginning of noise detection, the range will be narrowed 
soon, the increase in efficiency of processing is attained, the range will be extended soon and 
highly preciseHzation of the judgment is attained in the advanced stage. Furthermore in the 
stage of amendment of a pixel, local continuity with an adjacent pixel can be given to a defect 
pixel by amending a defect pixel soon using the gradation level of a pixel within the limits. 
[0050](A 2nd embodiment) Drawing 5 , drawin g 6, and drawing 7 explain the image processing 
method and image processing device which are a 2nd embodiment of this invention. Drawing 5 is 
a block diagram showing the functional constitution of an image processing device, gives the 
same numerals to the block of the same function as a 1st embodiment, and omits explanation. In 
drawing 5 , 1st rate F1 of flatness and the 2nd rate of flatness F2 calculation part, and 503 are 
rate threshold of flatness F3 set parts the image processing portion which applied this invention 
501, and 502. 

[0051 ]In the above-mentioned composition, a portion which is different from a 1st embodiment 
about the image processing method in a 2nd embodiment is explained, referring to drawing 6 in 
which the flow chart and concentration frequency distribution of drawing 6 are shown. Also in 
drawing 6 , explanation is omitted about the same processing as drawing 2 of a 1st embodiment. 
[0052]In a 2nd embodiment, the frequency of the image data for every gradation range set as the 
level width set part 1 10 is computed in Step S601, The 2nd which exist in the rate (rate F1 of 
flatness) over the total number of object picture elements of the pixel number which exists in 
the largest gradation level width of frequency, and the gradation level width which does not 
overlap with the above-mentioned level width is asked for the rate (rate F2 of flatness) over the 
total number of object picture elements of frequency. For example, the case of concentration- 
frequency-distribution drawing 7 of the noise picture which exists in the edge part of an object 
is considered. When the level width set as the level width set part 1 10 is 20, the concentration 
frequency in each tonal range is as follows. 
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[0053] 

gradation level Concentration frequencies 0-19 31-20 32-21 4...12-31 8...81-100 13 .181 to 
2001 ...246-255 0 — and. The 1st rate F1 of flatness =0.52 is calculated by breaking the 
concentration frequency 1 3 with the largest value by a total of 25 object picture elements 
among these concentration frequencies. Next, the 2nd rate of flatness F2=0.32 is calculated by 
breaking 8 whose concentration frequency is [ 2nd ] the largest by a total of 25 object picture 
elements in the range which does not overlap with the gradation level ranges 81-100 in which 
the largest concentration frequency exists. Calculation which asks for 1st rate F1 of flatness and 
the 2nd rate F2 of flatness from concentration frequency distribution is performed by rate F1 of 
flatness, and the F2 calculation part 502. 

[0054]Next, in Step S602, it is judged whether by the defect pixel judgment part 113, the rate 
threshold F3 of flatness, 1st rate F1 of flatness, and the 2nd rate F2 of flatness which were set 
up by the rate threshold of flatness F3 set part 503 are compared, and it is set to F1 >=F3 and 
F2 >=F3. When set to F1 >=F3 and F2 >=F3, it progresses to Step S603. Otherwise, a noticed 
picture element is moved to the following unsettled pixel. 

[0055] Next, at Step S603, a defect pixel is extracted out of an object image, and correction 
processing is performed from a normal region portion without a defect. The 1st adjusted value 
R1 and 2nd adjusted value R2 are first computed about the pixel in an object picture element 
group, respectively from the gradation level of two or more pixels used in order to ask for 1st 
rate F1 of flatness, and the 2nd rate F2 of flatness. R1=93 which averaged in the case of drawing 
7_(for example, the gradation level of the pixel to which the 1 st adjusted value R1 exists in the 
gradation level width 81-100), and R2=21 which averaged the gradation level of the pixel to which 
the 2nd adjusted value R2 exists in the gradation level width 12-31 can be found. A pixel with a 
larger gradation level difference with this 1st adjusted value R1 and 2nd adjusted value R2 than 
the threshold deltaF3 both set as the deltaFgradation level difference threshold value 3 set part 
1 14 is extracted as a defect pixel. Next, the defect pixel is replaced by the 1st adjusted value R1 
calculated previously. 

[0056]Calculation of the 1st and 2nd adjusted values, extraction of a defect pixel, and correction 
processing of a defect pixel are performed by the defect pixel corrected part 1 1 5. The following 
operations are the same as that of a 1st embodiment. 

[0057]In the case of this embodiment, even if it is a noise which exists in the edge part of an 
object, it can judge that a noticed picture element and the pixel of the neighborhood are noises 
by seeing two surface smoothness. 
[0058] 

[Effect of the lnvention]As explained above, according to this invention, it becomes possible to 
shorten correction processing time substantially, without becoming possible to detect only the 
dust noise by dust etc. automatically as a defect pixel, and to correct it, and causing degradation 
of a picture. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram of the image processing device in a 1st embodiment of this 
invention. 

[Drawing 2] tt is a flow chart explaining the operation in a 1st embodiment of this invention. 
[Drawing 3] lt is a figure showing the picture-element-data arrangement in a 1st embodiment of 
this invention. 

[Drawing 4] It is an example of concentration frequency distribution of the picture element data 
in a 1st embodiment of this invention. 

[Drawing 5] It is a block diagram of the image processing device in a 2nd embodiment of this 
invention. 

[Drawing 6] It is a flow chart explaining the operation in a 2nd embodiment of this invention. 
[Drawing 7] It is an example of concentration frequency distribution of the picture element data 
in a 2nd embodiment of this invention. 
[Description of Notations] 

101 Image reader 

102 Image processing portion 

103 Interface (I/F) 

1 04 Image memory 

105 deltaLgradation level difference 1 calculation part 

106 deltaLgradation level difference threshold value 2 set part 

1 07 Radius set part 



[Translation done.] 
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